The Health Education Impact Questionnaire (heiQ): An outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions

Objective: This paper describes the development and validation of the Health Education Impact Questionnaire (heiQ). The aim was to develop a user-friendly, relevant, and psychometrically sound instrument for the comprehensive evaluation of patient education programs, which can be applied across a broad range of chronic conditions.

Methods: Item development for the heiQ was guided by a Program Logic Model, Concept Mapping, interviews with stakeholders and psychometric analyses. Construction (N = 591) and confirmatory (N = 598) samples were drawn from consumers of patient education programs and hospital outpatients. The properties of the heiQ were investigated using item response theory and structural equation modeling.

Results: Over 90 candidate items were generated, with 42 items selected for inclusion in the final scale. Eight independent dimensions were derived: Positive and Active Engagement in Life (five items, Cronbach's alpha (α) = 0.86); Health Directed Behavior (four items, α = 0.80); Skill and Technique Acquisition (five items, α = 0.81); Constructive Attitudes and Approaches (five items, α = 0.81); Self-Monitoring and Insight (seven items, α = 0.70); Health Service Navigation (five items, α = 0.82); Social Integration and Support (five items, α = 0.86); and Emotional Wellbeing (six items, α = 0.89).

Conclusion:The heiQ has high construct validity and is a reliable measure of a broad range of patient education program benefits.

Practice Implications: The heiQ will provide valuable information to clinicians, researchers, policymakers and other stakeholders about the value of patient education programs in chronic disease management.

Adaptation and validation of the Japanese version of the health education impact questionnaire (heiQ-J) for the evaluation of self-management education interventions

Aim:  

Measurement of stable changes of self-management skills after rehabilitation: a latent state-trait analysis of the Health Education Impact Questionnaire (heiQ™)

To assess stable effects of self-management programs, measurement instruments should primarily capture the attributes of interest, for example, the self-management skills of the measured persons. However, measurements of psychological constructs are always influenced by both aspects of the situation (states) and aspects of the person (traits). This study tests whether the Health Education Impact Questionnaire (heiQ™), an instrument assessing a wide range of proximal outcomes of self-management programs, is primarily influenced by person factors instead of situational factors. Furthermore, measurement invariance over time, changes in traits and predictors of change for each heiQ™ scale were examined.

Measurement invariance across chronic conditions: a systematic review and an empirical investigation of the Health Education Impact Questionnaire (heiQ™).

To examine whether lack of measurement invariance (MI) influences mean comparisons among different disease groups, this paper provides (1) a systematic review of MI in generic constructs across chronic conditions and (2) an empirical analysis of MI in the Health Education Impact Questionnaire (heiQ™).

Measurement of stable changes of self-management skills after rehabilitation: a latent state–trait analysis of the Health Education Impact Questionnaire (heiQ™)

Methods: Subjects were N = 580 patients with rheumatism, asthma, orthopedic conditions or inflammatory bowel disease, who filled out the heiQ™ at the beginning, the end of and 3 months after a disease-specific inpatient rehabilitation program in Germany. Structural equation modeling techniques were used to estimate latent trait-change models and test for measurement invariance in each heiQ™ scale. Coefficients of consistency, occasion specificity and reliability were computed.

Measurement invariance of English and French Health Education Impact Questionnaire (heiQ) empowerment scales validated for cancer

PURPOSE: If measurement invariance (MI) is demonstrated for a scale completed by respondents from two different language groups, it means that the scale measures the same construct in the same way in both groups. We assessed MI of the French- and English-language versions of the five Health Education Impact Questionnaire (heiQ) empowerment scales validated for the cancer setting. METHODS: Data came from two cross-sectional studies of Canadian cancer survivors (704 English, 520 French). Single-group confirmatory factor analysis (CFA) was used to test whether the hypothesized factor structure of the French-language heiQ empowerment scales fit the data. Multi-group CFAs were conducted to assess different levels of MI conditions (configural, metric, scalar, strict, as well as MI of factor variances, covariances, and latent means) of the French- and English-language heiQ empowerment scales. RESULTS: The correlated five-factor model showed good fit in both language groups (goodness-of-fit indices: CFI ≥ .97; RMSEA ≤ .07). Goodness-of-fit indices and tests of differences in fit between models supported MI of the five-factor model across the two language groups (∆CFI ≤ -.010 combined with ∆RMSEA ≤ .015). CONCLUSIONS: The French- and English-language heiQ empowerment scales measure the same five dimensions of empowerment in the same way across both language groups. Thus, any observed similarities or differences between French- and English-speaking respondents completing these scales are valid and reflect similarities or differences in empowerment across language groups, not measurement artifact. Consequently, heiQ empowerment data from English- and French-speaking respondents can be directly pooled or contrasted in data analyses.

Assessment of proximal outcomes of self-management programs : translation and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQtm)

Purpose This paper describes the translation, cultural adaption, and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQ™), a widely used generic instrument assessing a wide range of proximal outcomes of self-management programs.

Methods The translation was carried out according to international standards and included forward and backward translations. Comprehensibility and content validity were tested using cognitive interviews with 10 rehabilitation inpatients. Psychometric properties were examined in rehabilitation inpatients (n = 1,202) with a range of chronic conditions. Factorial validity was assessed using confirmatory factor analysis; concurrent validity was explored by correlations with comparator scales.

Results The items of the German heiQ™ were well understood by rehabilitation inpatients. The structure of the eight heiQ™ scales was replicated after minor adjustment. heiQ™ scales had higher correlations with comparator scales with similar constructs, particularly mental health concepts than with physical health. Moreover, all heiQ™ scales differentiated between individuals across different levels of depression.

Conclusion The German heiQ™ is comprehensible for German-speaking patients suffering from different types of chronic conditions; it assesses relevant outcomes of self-management programs in a reliable and valid manner. Further studies involving its practical application are warranted.

Health-related empowerment in cancer: validity of scales from the health education impact questionnaire

Empowerment refers to an individual's feelings of being able to manage the challenges of the cancer experience and of having a sense of control over one's life. However, empowerment questionnaires that have been validated for the cancer setting are lacking. The objective of this study was to validate scales from the Health Education Impact Questionnaire (heiQ), which assesses the effects of health education programs among individuals with chronic conditions. The heiQ scales Social integration and support, Health service navigation, Constructive attitudes and approaches, Skill and technique acquisition, and Emotional distress were identified as key dimensions of empowerment for the cancer context.

Factor structure and measurement invariance of the Health Education Impact Questionnaire: does the subjectivity of the response perspective threaten the contextual validity of inferences?

Objective:
On-going evidence is required to support the validity of inferences about change and group differences in the
evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.
Methods:
An archived dataset of responses to the most recent version of the English-language Health Education Impact
Questionnaire that uses four rather than six response options (N=3221) was analysed using exploratory structural equation
modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were
studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum
constraints necessary for model identification.
Results:
The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was
found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar
invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).
Conclusion:
The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre–post evaluation designs and system-level monitoring and evaluation.

Cross-cultural adaption of the Health Educaiton Impact Questionnaire: experimental study showed expert committee, not back-translation, added value

Objectives
To assess the contribution of back-translation and expert committee to the content and psychometric properties of a translated multidimensional questionnaire.

Study Design and Setting
Recommendations for questionnaire translation include back-translation and expert committee, but their contribution to measurement properties is unknown. Four English to French translations of the Health Education Impact Questionnaire were generated with and without committee or back-translation. Face validity, acceptability, and structural properties were compared after random assignment to people with rheumatoid arthritis (N = 1,168), chronic renal failure (N = 2,368), and diabetes (N = 538). For face validity, 15 bilingual people compared translations quality with the original. Psychometric properties were examined using confirmatory factor analysis (metric and scalar invariance) and item response theory.

Results
Qualitatively, there were five types of translation errors: style, intensity, frequency/time frame, breadth, and meaning. Bilingual assessors ranked best the translations with committee (P = 0.0026). All translations had good structural properties (root mean square error of approximation <0.05; comparative fit index [CFI], ≥0.899; and Tucker–Lewis index, ≥0.889). Full measurement invariance was observed between translations (ΔCFI ≤ 0.01) with metric invariance between translations and original (lowest ΔCFI = 0.022 between fully constrained models and models with free intercepts). Item characteristic curve analyses revealed no significant differences.

Conclusion
This is the first experimental evidence that back-translation has moderate impact, whereas expert committee helps to ensure accurate content.